System and method for excerpt creation by designating a text segment using speech

ABSTRACT

An apparatus includes at least one input device configured to receive a speech input, a display configured to present predetermined content acquired by the apparatus from which excerpts may be extracted, and a processor configured to execute computer readable program code. The computer readable program code is configured to collect a speech recognition vocabulary set that corresponds to content visible on the display such that at least one vocabulary word in the speech recognition vocabulary set is the same as a word presented on the display, designate a segment of the content to be excerpted based on the speech input, and create a link to a source of the excerpted content and display the link with the excerpted content.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.12/125,377, filed on 22 May 2008, the disclosure of which isincorporated herein by reference in its entirety.

BACKGROUND

The disclosed embodiments generally relate to user interfaces and moreparticularly to user interfaces for managing and accessing data.

Generally, personal content management tools enable people to organize,subscribe, publish and find information that resides on local systemsand remote servers. These management tools are generally applied todevices with large screens with limited applications in devices withsmall screens and limited computing capabilities such as for examplemobile communication devices. For example, devices with small screensgenerally only allow a user to view one page or a portion of a page ofcontent at a time. Most mobile communication devices generally do notsupport viewing multiple windows where each window includes content fromdifferent documents or sources. Selecting and editing information, suchas that found in web pages in a mobile devices generally is difficult asthe mobile device include a limited key pad, typically a 12 key input.Some mobile devices include other inputs such as a stylus for use on atouch screen, however, the user generally has to multitask betweenseveral applications to take content from one application and insertthat content into another application such as copying and pastingcontent from a web page to a notepad application.

Some web notebook applications allow web surfers to clip and collectinformation from, for example, web pages to an online notebookapplication while linking the clipped content back to its source (e.g.the web page). However, these applications generally do not providetheir full functionality on mobile devices. For example, the mobileversion of the web notebooks generally only allows a user to write notesthat are transferred to the web notebook. However, these notes are standalone notes that are manually entered and are not excerpted from, forexample, a web page or other document.

It would be advantageous to be able to easily excerpt content fromdocuments in a mobile device. It would also be advantageous to easilyview the source of the excerpted content.

SUMMARY

The aspects of the disclosed embodiments are directed to a methodincluding displaying content on a display of a device, receiving aspeech input designating a segment of the content to be excerpted andtransferring the excerpted content to a predetermined location forstorage and retrieval.

Another aspect of the disclosed embodiments is directed to a computerprogram product stored in a memory. The computer program productincludes computer readable program code embodied in a computer readablemedium for displaying content on a display of a device, receiving aspeech input designating a segment of the content to be excerpted andtransferring the excerpted content to a predetermined location forstorage and retrieval.

Other aspects of the disclosed embodiments are directed to a systemincluding a remote server and a portable communication device includinga display configured to present predetermined content and a processorconfigured to request the predetermined content from the remote server,recognize a speech input for designating a segment of the content to beexcerpted and transfer the excerpted content to a predetermined locationfor storage and retrieval.

Still other aspects of the disclosed embodiments are directed to anapparatus and a user interface including at least one input deviceconfigured to receive a speech input, a display configured to presentpredetermined content acquired by the apparatus and a processorconfigured to recognize the speech input for designating a segment ofthe content to be excerpted and transfer the excerpted content to apredetermined location for storage and retrieval.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing aspects and other features of the embodiments areexplained in the following description, taken in connection with theaccompanying drawings, wherein:

FIG. 1 shows a block diagram of a system in which aspects of thedisclosed embodiments may be applied;

FIGS. 2A and 2B illustrate a flow diagrams according to aspects of thedisclosed embodiments;

FIG. 3 illustrates displaying content with the system of FIG. 1according to aspects of the disclosed embodiments;

FIGS. 4 and 5 illustrate exemplary systems in which aspects of thedisclosed embodiments may be applied;

FIGS. 6A-6I illustrate exemplary screen shots in accordance with aspectsof the disclosed embodiments;

FIGS. 7A and 7B are illustrations of exemplary devices that can be usedto practice aspects of the disclosed embodiments;

FIG. 8 illustrates a block diagram of an exemplary system incorporatingfeatures that may be used to practice aspects of the disclosedembodiments; and

FIG. 9 is a block diagram illustrating the general architecture of anexemplary system in which the devices of FIGS. 7A and 7B may be used.

DETAILED DESCRIPTION

FIG. 1 illustrates one embodiment of a system 100 in which aspects ofthe disclosed embodiments can be applied. Although the disclosedembodiments will be described with reference to the embodiments shown inthe drawings and described below, it should be understood that thesecould be embodied in many alternate forms. In addition, any suitablesize, shape or type of elements or materials could be used.

Aspects of the disclosed embodiments allow a user of a mobile device orsystem, such as system 100, to easily excerpt content from any suitabledocument, place that excerpted content in a predetermined application,and maintain the link between the excerpted content and its source.Aspects of the disclosed embodiments provide a solution for convenientlymaking excerpts in a mobile device from mobile content by excerptingselected content. The content can be selected by speaking words includedin the content where the words identify the content that is selected.For example, referring to FIG. 2A, content is presented on, for example,display 114 of the system 100 (FIG. 2A, Block 200). The term “content”as used herein generally refers to words, pictures, images, symbols,characters or any other suitable items that are presented on a display.It is noted that while the aspects of the disclosed embodiments aredescribed herein with respect to web browsers and web pages the aspectsof the disclosed embodiments are not limited thereto. As non-limitingexamples, aspects of the disclosed embodiments can be applied to anysuitable documents including, but not limited to, electronic books, wordprocessing documents, photographs and images. An excerpt application 196of the system (FIG. 2A, Block 205) is activated. The system 100 maypresent any suitable selections or options for selecting content to beexcerpted (FIG. 2A, Block 210), as will be described in greater detailbelow. One aspect of the disclosed embodiments provides for selectingthe excerpted content through a speech recognition function or module137 of the system (FIG. 2A, Block 215), although the aspects of thedisclosed embodiments are not limited to selection by speechrecognition. In other examples, any suitable input method can be usedfor selecting the excerpted content including, but not limited to, keys110, touch/proximity screen 112 of the system and the speech recognitionor any combination thereof.

In one embodiment, the speech recognition module 137 includes arecognition engine 137A, an acoustic model 137B and a language model137C. The features of the speech recognition module 137 are describedherein for exemplary purposes only and are not intended to limit thespeech recognition module features. For example, the speech recognitionmodule may also include any other suitable features and is not limitedto those described herein. The language model 137C is flexible and mayfacilitate improving or maximizing the recognition accuracy of thespeech recognition module 137. The language model 137C may be configuredto collect and organize vocabulary words that may be spoken by the userto, for example, select the excerpted content in any suitable manner. Inone aspect of the disclosed embodiments the vocabulary words are limitedto the words, characters and/or symbols presented on the display 114.For example, FIG. 3 shows content from an exemplary web page 300, asindicated by the dashed line. The area 314 represents the viewable areaof the display such that the words included in the vocabulary are onlythose that are visible in the display area 314. As the display changes(e.g. the content is scrolled up/down/left/right) the vocabulary isupdated to include newly visible content while the content that is nolonger visible in the display area 314 is removed from the vocabulary.In alternate embodiments the words that were added to the vocabularywhile being presented on the display may remain in the vocabulary eventhough they are scrolled off of or otherwise removed from the display.In other examples, the vocabulary words may include the words,characters and/or symbols (collectively referred to herein as words)that are not visible or were not previously presented on the display 114but are included in the document being viewed. Generally, a smallervocabulary set will optimize the performance of the speech recognitionmodule 137. The vocabulary words can be organized by the language model137C in any suitable manner including, but not limited to, by isolatingwords, grammar rules and statistical models.

Referring also to FIG. 2B, when the excerpt application 196 is activatedthe language model 137C may collect the vocabulary set in any suitablemanner (FIG. 2B, Block 240). In one aspect of the disclosed embodiments,the vocabulary set is created by collecting and storing items presentedon the display 114 as described above. For example, the language model137C may be configured to recognize only the words shown on the displayso as to limit the size of the vocabulary set so that performance of thespeech recognition module 137 is maximized. Where for example, a contentbrowser 195 is active such that the items or content on the displayincludes words that are computer recognizable, information pertaining tothe content, including texts, links and pictures, can be obtained by thelanguage model 137C through the content browser 195. Where theindividual items presented on the display are not computer readable,such as in an image, text based content of the image can be recognizedthrough, for example, optical character recognition (OCR). In thisaspect the speech recognition module 137 may work in conjunction withOCR module 138 for creating the vocabulary. The words in the vocabularyare organized by the language model 137C (FIG. 2B, Block 250). Forexample, grammar rules or statistical models can be extracted from thecontent presented on the display 114. In one aspect, general rules ormodels can be created from a larger training corpus so that the speechrecognition relating to the content presented on the display can betrained in a minimized amount of time. In another aspect, the relatedwords and corresponding weights in the model or rules can be adjustedaccording to the content presented on the screen to, for example,maximize the speech recognition accuracy. In other examples, the wordsin the vocabulary can be organized in any suitable manner with anysuitable rules or models.

Extraction of the grammar rules and/or statistical models can beperformed by the system 100 or external to the system 100 (FIG. 2B,Block 260). In one example, as can be seen in FIG. 4, where theextraction is performed by the system 100 (illustrated in the Figure asmobile device 400), the device 400 transmits a link or request 420 for apredetermined document or content, which in this example is a web page,to a server 410. The server sends the content 430 of the document inresponse to the request where the processor 132 of the device 400analyzes the content 430, extracts the rules and/or models and createsthe vocabulary. In another example, referring to FIG. 5, where theextraction is performed external to the system 100, the device 400 maysend a link 520 to, for example, a proxy server 500. The proxy servermay forward the link 520 to server 410, which in turn sends therequested content 530 to the proxy server 500. The proxy server 500 isconfigured to extract the rules and/or models from the content 530. Theproxy server 500 sends the content including the rules and/or models 535to the device 400. In one aspect the extracted rules and/or models canbe embedded in the content so that their transmission into the device400 is transparent to the user while allowing the rules and models to beaccepted by the speech recognition module 137.

The system 100 may identify the desired content based on the userselection and indicate the selection to the user in any suitable mannersuch as visually or audibly (FIG. 2A, Block 220). As can be seen in FIG.4, identified content 450 is shown in bold print but in alternateembodiments the identified content can be indicated in any suitablemanner including, but not limited to, highlighting, changing font typeand/or color and underlining. When the user finishes identifying contentto be excerpted, the system may present to the user selections forexcerpting the identified content to any suitable application andstoring the identified content in any suitable location (FIG. 2A, Block230).

Referring now to FIGS. 6A-6I, an example of content excerption will bedescribed in greater detail. Again, the system 100 is represented inFIGS. 6A-6I as mobile device 400 for exemplary purposes only. As can beseen in FIG. 6A, a web page 610 is acquired and displayed on a display602 of the device 400. In this example, the excerpt application 196 maybe activated by depressing or otherwise activating, key 600 of thedevice. The key 600 may be any suitable key including, but not limitedto, a dedicated key or an assignable key. In alternate embodiments theexcerpt application 196 can be activated in any suitable manner. Theexcerpt application 196 may cause excerpt selections 621-624 to bedisplayed on the display 602. In this example, the selections 621-624are displayed in a pop-up menu or window 620 but in alternateembodiments the selections may be presented in any suitable manner. Ascan be seen in FIG. 6B the selections allow the user to “read/reset thebeginning word” 621, “read/reset the ending word” 622, “excerpt” 623 and“cancel the selection” 624. These selections 621-624 are only exemplaryin nature and it should be understood that the selections may includeany suitable selections.

In one aspect of the disclosed embodiments, to identify content to beexcerpted the beginning word in the excerption is selected by the userthrough, for example, selection 621. In one embodiment, the device 400may prompt 630 the user to speak the word(s) at the beginning of thecontent to be excerpted as shown in FIG. 6C. In alternate embodiments,the prompt may be an audible prompt or a combination of a visual andaudible prompt. In other alternate embodiments other input methods, asdescribed above, may be used for selecting the excerpted content. Thespeech recognition module 137 recognizes the spoken words and identifiesthose words within the displayed content. In this example, the beginningwords 635 “The brother and sister” are spoken. The device 400 recognizesthe beginning words 635 and identifies them by highlighting those wordson the display 602 as shown in FIG. 6D. The ending words of the contentto be excerpted are selected through, for example, selection 622. Thedevice 400 prompts the user to speak the ending words in a mannersubstantially similar to that described above with respect to FIG. 6C.In this example, the ending words may be “from time to time, is 11”. Thedevice recognizes the ending words and identifies those words in thedisplayed content. In other aspects the predetermined commands may beused to select portions of the displayed content. For example, theexcerpt application may include commands such as, “first line”, “firstparagraph”, “whole screen”, “next page”, “current page”, “last line”,“reset the beginning word”, “reset the ending word” or any othersuitable commands for identifying one or more portions of the displayedcontent for excerption.

In one embodiment, as shown in FIG. 6E, after the ending words areidentified the device highlights the content to be excerpted 650. Inother embodiments the device may highlight the ending words in mannersubstantially similar to that described above with respect to thebeginning words 635. The content to be excerpted can be excerptedthrough, for example, selection 623. When the content is excerpted thedevice may indicate 660 in any suitable manner that the content has beenexcerpted as shown in, for example, the pop-up window of FIG. 6F. Theindication 660 may include the location where the excerpted content issent which, for exemplary purposes only, in this example is the NokiaExcerpter but in alternate embodiments may be any suitable location orapplication. In other embodiments, the excerpt application 196 mayinclude any suitable commands or selections for selecting the content tobe excerpted. As non-limiting examples, the commands or selections canprovide for selecting a predetermined line of the displayed content, allof the content presented on the display, a predetermined paragraph ofthe displayed content, a predetermined page of the displayed contentand/or any other suitable commands or selections for selecting apredetermined portion of displayed content. In alternate embodiments thecommands or selections may provide for selecting content that is notdisplayed on the display 114. For example, where a predetermined page isspecified, all of the page's content can be selected without building avocabulary for the entire page. Where the user specified an incorrectportion of the content to be excerpted or decides to expand or contractthe amount of excerpted content the user can, for example, throughselections 621, 622, 624 reset the beginning or ending word to redefinethe selected content or cancel the selection.

Referring to FIGS. 6G and 6H, where a word that is spoken whenselecting, for example, the beginning or ending word of the excerption,is repeated in the displayed content the device is configured to allowthe user to designate an instance of the word to be selected. Forexample, if the word “sister” is spoken the device 400 recognizes andidentifies the word “sister” in two locations 640, 641 on the display.The device 400 may prompt the user for designating which location of theword is to be used for determining the content to be excerpted. In oneexample, the user may audibly identify which instance of the word touse. In other examples, a key of the device may be activated, such asnavigation key 601, to toggle between the instances of the spoken word.In still other examples, the desired instance of the word can beselecting with a pointing device through a touch enable screen of thedevice 400. In alternate embodiments the desired instance of a word canbe designated in any suitable manner and the aspects of the disclosedembodiments are not limited to those examples described above. As can beseen in FIGS. 6G and 6H the designated instance of the word may behighlighted in any suitable manner, such as those described above withrespect to FIG. 4, so that the selected instance of the word is easilyidentifiable. In this example, the designated instance of the word“sister” is highlighted by forming a box around the selected instance ofthe word.

FIG. 6I illustrates an exemplary excerpt organizer 672 corresponding toa location where the excerpts are sent. The contents and format of theexcerpt display screen 670 are for exemplary purposes only and inalternate embodiments the excerpt display screen 670 may include anysuitable information presented in any suitable manner. Here the excerptdisplay screen 670 includes a date 680 corresponding to a date on whichthe excerpts are made such that the excerpts can be chronologicallyorganized and/or searched. In alternate embodiments, the excerptorganizer 672 may include an organization menu for categorizing theexcerpts. In another aspect the system 100 may be configured to prompt auser to specify a category, topic, or keyword for identifying theexcerpt in the excerpt organizer 672, otherwise a default category maybe designated by the system 100. The default category may be a userdefined category or one that is designated by the excerpt organizer672/excerpt application 196. In other alternate embodiments, the excerptdisplay screen 670 may include a search feature that allows a user tosearch the excerpts by, for example, a word included in the excerpt,date, topic, category or any other suitable search criteria. In thisexample, the excerpt display screen 670 includes a link 690 to thedocument from which the excerptions were made. As non-limiting examples,the link 690 may represent the title of the document, a file name of thedocument, a title of a web page, a web address or any other suitableidentifying information that when selected automatically directs theuser back to the original document. In other examples, the system 100may present selections to the user when the link 690 is selected so thatthe source content provided by the link is not presented upon, forexample, an accidental selection of the link 690. One or more excerpts691, 692 corresponding to the link 690 may be displayed along with thelink. The excerpts can be viewed by, for example, selecting a desiredexcerpt in any suitable manner, such as those described above withrespect to selecting the excerpted content, so that the entirety of theexcerpt is presented to the user through the display 602. The excerptscan be stored in the device 400 or in any suitable memory external tothe device for retrieval at any suitable time. In one example, theexcerpts may be stored in a central location, such as a network server,so they are accessible by the device 400 and other devices such as othermobile or non-mobile devices.

Referring again to FIG. 1, the system 100 of the disclosed embodimentscan include input device 104, output device 106, process module 122,applications module 180, and storage/memory 182. The componentsdescribed herein are merely exemplary and are not intended to encompassall components that can be included in the system 100. The device 100can also include one or more processors to execute the processes,methods and instructions described herein. The processors can be storedin the device 100, or in alternate embodiments, remotely from the device100.

The input device 104 is generally configured to allow a user to inputdata and commands to the system or device 100. The input device 104 mayinclude any suitable input features including, but not limited to hardand/or soft keys 110 and touch/proximity screen 112. The output device106 is configured to allow information and data to be presented to theuser via the user interface 102 of the device 100. The process module122 is generally configured to execute the processes and methods of thedisclosed embodiments. The application process controller 132 can beconfigured to interface with the applications module 180 and executeapplications processes with respect to the other modules of the system100. The communication module 134 may be configured to allow the deviceto receive and send communications, messages and data (collectivelyreferred to herein as communications), such as, for example, one or moreof voice calls, text messages, chat messages, email and data receivedfrom the Internet. The communications module 134 is also configured toreceive communications from other devices and systems.

The applications module 180 can include any one of a variety ofapplications or programs that may be installed, configured or accessibleby the device 100. In one embodiment the applications module 180 caninclude excerpt application 199, web or content browser 195, office,business, media player and multimedia applications. The applications orprograms can be stored directly in the applications module 180 oraccessible by the applications module. For example, in one embodiment,an application or program such as the excerpt application 196 may benetwork based, and the applications module 180 includes the instructionsand protocols to access the program/application and render theappropriate user interface and controls to the user.

In one embodiment, the system 100 comprises a mobile communicationdevice. The mobile communication device can be Internet enabled. Theinput device 104 can also include a camera or such other image capturingsystem 720 (See FIG. 7A). In one aspect the imaging system 720 may beused to image any suitable text. The image of the text may be convertedinto, for example, an editable document (e.g. word processor text, emailmessage, text message or any other suitable document) with, for example,an optical character recognition module 139. Excerpts can be taken fromthe recognized text in a manner substantially similar to that describedabove with respect to FIGS. 2A-6I. The applications 180 of the devicemay include, but are not limited to, data acquisition (e.g. image, videoand sound), multimedia players (e.g. video and music players) andgaming, for example. In alternate embodiments, the system 100 caninclude other suitable devices, programs and applications.

While the input device 104 and output device 106 are shown as separatedevices, in one embodiment, the input device 104 and output device 106can be combined and be part of and form the user interface 102. The userinterface 102 can be used to display information pertaining to content,control, inputs, objects and targets as described herein.

The display 114 of the system 100 can comprise any suitable display,such as a touch screen display, proximity screen device or graphicaluser interface. The type of display is not limited to any particulartype or technology. In other alternate embodiments, the display may beany suitable display, such as for example a flat display 114 that istypically made of a liquid crystal display (LCD) with optional backlighting, such as a thin film transistor (TFT) matrix capable ofdisplaying color images.

In one embodiment, the user interface of the disclosed embodiments canbe implemented on or in a device that includes a touch screen display ora proximity screen device 112. In alternate embodiments, the aspects ofthe user interface disclosed herein could be embodied on any suitabledevice that will display information and allow the selection andactivation of applications or system content. The terms “select”,“touch” and “indicate” are generally described herein with respect to atouch screen-display. However, in alternate embodiments, the terms areintended to encompass the required user action with respect to otherinput devices. For example, with respect to a proximity screen device,it is not necessary for the user to make direct contact in order toselect an object or other information. Thus, the above noted terms areintended to include that a user only needs to be within the proximity ofthe device to carry out the desired function, such as for example,selecting the text(s) to be corrected as described above.

Similarly, the scope of the intended devices is not limited to singletouch or contact devices. Multi-touch devices, where contact by one ormore fingers or other pointing devices can navigate on and about thescreen, are also intended to be encompassed by the disclosedembodiments. Non-touch devices are also intended to be encompassed bythe disclosed embodiments. Non-touch devices include, but are notlimited to, devices without touch or proximity screens, where navigationon the display and menus of the various applications is performedthrough, for example, keys 110 of the system or through voice commandsvia voice recognition features of the system.

Some examples of devices on which aspects of the disclosed embodimentscan be practiced are illustrated with respect to FIGS. 7A and 7B. Thedevices are merely exemplary and are not intended to encompass allpossible devices or all aspects of devices on which the disclosedembodiments can be practiced. The aspects of the disclosed embodimentscan rely on very basic capabilities of devices and their user interface.For example, in one aspect buttons or key inputs can be used forselecting the excerpted content as described above with respect to FIGS.6A-6I.

As shown in FIG. 7A, in one embodiment, the terminal or mobilecommunications device 700 may have a keypad 710 as an input device and adisplay 720 for an output device. The keypad 710 may include anysuitable user input devices such as, for example, amulti-function/scroll key 730, soft keys 731, 732, a call key 733, anend call key 734 and alphanumeric keys 735. In one embodiment, thedevice 700 may also include an image capture device 720 as a furtherinput device as described above. The display 720 may be any suitabledisplay, such as for example, a touch screen display or graphical userinterface. The display may be integral to the device 700 or the displaymay be a peripheral display connected or coupled to the device 700. Apointing device, such as for example, a stylus, pen or simply the user'sfinger may be used in conjunction with the display 720 for cursormovement, menu selection and other input and commands. In alternateembodiments any suitable pointing or touch device, or other navigationcontrol may be used. In other alternate embodiments, the display may bea conventional display. The device 700 may also include other suitablefeatures such as, for example a loud speaker, tactile feedback devicesor connectivity port. The mobile communications device may have aprocessor 718 connected or coupled to the display for processing userinputs and displaying information on the display 720. A memory 702 maybe connected to the processor 718 for storing any suitable information,data, settings and/or applications associated with the mobilecommunications device 700 such as those described above.

In the embodiment where the device 700 comprises a mobile communicationsdevice, the device can be adapted for communication in atelecommunication system, such as that shown in FIG. 8. In such asystem, various telecommunications services such as cellular voicecalls, worldwide web/wireless application protocol (www/wap) browsing,cellular video calls, data calls, facsimile transmissions, datatransmissions, music transmissions, still image transmission, videotransmissions, electronic message transmissions and electronic commercemay be performed between the mobile terminal 800 and other devices, suchas another mobile terminal 806, a line telephone 832, an internetclient/personal computer 826 and/or an internet server 822.

In one embodiment the system is configured to enable any one orcombination of data transfer, voice communication, chat messaging,instant messaging, text messaging and/or electronic mail. It is to benoted that for different embodiments of the mobile terminal 800 and indifferent situations, some of the telecommunications services indicatedabove may or may not be available. The aspects of the disclosedembodiments are not limited to any particular set of services orapplications in this respect.

The mobile terminals 800, 806 may be connected to a mobiletelecommunications network 810 through radio frequency (RF) links 802,808 via base stations 804, 809. The mobile telecommunications network810 may be in compliance with any commercially available mobiletelecommunications standard such as for example global system for mobilecommunications (GSM), universal mobile telecommunication system (UMTS),digital advanced mobile phone service (D-AMPS), code division multipleaccess 2000 (CDMA2000), wideband code division multiple access (WCDMA),wireless local area network (WLAN), freedom of mobile multimedia access(FOMA) and time division-synchronous code division multiple access(TD-SCDMA).

The mobile telecommunications network 810 may be operatively connectedto a wide area network 820, which may be the Internet or a part thereof.A server, such as Internet server 822 can include data storage 824 andprocessing capability and is connected to the wide area network 820, asis an Internet client/personal computer 826. The server 822 may host aworldwide web/wireless application protocol server capable of servingworldwide web/wireless application protocol content to the mobileterminal 800.

A public switched telephone network (PSTN) 830 may be connected to themobile telecommunications network 810 in a familiar manner. Varioustelephone terminals, including the stationary line telephone 832, may beconnected to the public switched telephone network 830.

The mobile terminal 800 is also capable of communicating locally via alocal link(s) 801 to one or more local devices 803. The local link(s)801 may be any suitable type of link with a limited range, such as forexample Bluetooth, a Universal Serial Bus (USB) link, a wirelessUniversal Serial Bus (WUSB) link, an IEEE 802.11 wireless local areanetwork (WLAN) link, an RS-232 serial link, etc. The local devices 803can, for example, be various sensors that can communicate measurementvalues or other signals to the mobile terminal 800 over the local link801. The above examples are not intended to be limiting, and anysuitable type of link may be utilized. The local devices 803 may beantennas and supporting equipment forming a wireless local area networkimplementing Worldwide Interoperability for Microwave Access (WiMAX,IEEE 802.16), WiFi (IEEE 802.11x) or other communication protocols. Thewireless local area network may be connected to the Internet. The mobileterminal 800 may thus have multi-radio capability for connectingwirelessly using mobile communications network 810, wireless local areanetwork or both. Communication with the mobile telecommunicationsnetwork 810 may also be implemented using WiFi, WorldwideInteroperability for Microwave Access, or any other suitable protocols,and such communication may utilize unlicensed portions of the radiospectrum (e.g. unlicensed mobile access (UMA)). In one embodiment, thecommunications module 134 is configured to interact with, andcommunicate to/from, the system described with respect to FIG. 8.

Although the above embodiments are described as being implemented on andwith a mobile communication device, it will be understood that thedisclosed embodiments can be practiced on any suitable deviceincorporating a display, processor, memory and supporting software orhardware. For example, the disclosed embodiments can be implemented onvarious types of music, gaming and/or multimedia devices with one ormore communication capabilities as described above. In one embodiment,the system 100 of FIG. 1 may be for example, a personal digitalassistant (PDA) style device 700′ illustrated in FIG. 7B. The personaldigital assistant 700′ may have a keypad 710′, a touch screen display720′, camera 721′ and a pointing device 750 for use on the touch screendisplay 720′. In still other alternate embodiments, the device may be apersonal computer, a tablet computer, touch pad device, Internet tablet,a laptop computer, a mobile terminal, a cellular/mobile phone, amultimedia device, a personal communicator, a television set top box orany other suitable device capable of containing for example a display114 shown in FIG. 1, and supported electronics such as the processor 718and memory 702 of FIG. 7A. In one embodiment, these devices will becommunication enabled over a wireless network.

The user interface 102 of FIG. 1 can also include menu systems 124coupled to the process module 122 for allowing user input and commandssuch as those described herein. The process module 122 provides for thecontrol of certain processes of the system 100 including, but notlimited to the controls for content excerption as described herein. Themenu system 124 can provide for the selection of different tools andapplication options related to the applications or programs running onthe system 100 in accordance with the disclosed embodiments. The menusystem 124 may also provide for configuring the speech recognitionmodule 137, the OCR module 138 and/or excerpt application 196 asdescribed above. In the embodiments disclosed herein, the process module122 receives certain inputs, such as for example, signals,transmissions, instructions or commands related to the functions of thesystem 100. Depending on the inputs, the process module 122 interpretsthe commands and directs the process control 132 to execute the commandsaccordingly in conjunction with the other modules and/or applications,such as for example, speech recognition module 137, OCR module 138,communication module 134 and excerpt application 196. In accordance withthe embodiments described herein, this can include excerpting anysuitable content presented by the system 100.

The disclosed embodiments may also include software and computerprograms incorporating the process steps and instructions describedabove. In one embodiment, the programs incorporating the process stepsdescribed herein can be stored on and/or executed in one or morecomputers. FIG. 9 is a block diagram of one embodiment of a typicalapparatus 900 incorporating features that may be used to practiceaspects of the disclosed embodiments. The apparatus 900 can includecomputer readable program code means for carrying out and executing theprocess steps described herein. In one embodiment the computer readableprogram code is stored in a memory of the device. In alternateembodiments the computer readable program code can be stored in memoryor a memory medium that is external to, or remote from, the apparatus900. The memory can be directly coupled or wirelessly coupled to theapparatus 900. As shown, a computer system 902 may be linked to anothercomputer system 904, such that the computers 902 and 904 are capable ofsending information to each other and receiving information from eachother. In one embodiment, computer system 902 could include a servercomputer adapted to communicate with a network 906. Alternatively, whereonly one computer system is used, such as computer 904, computer 904will be configured to communicate with and interact with the network906. Computer systems 902 and 904 can be linked together in anyconventional manner including, for example, a modem, wireless, hard wireconnection, or fiber optic link. Generally, information can be madeavailable to both computer systems 902 and 904 using a communicationprotocol typically sent over a suitable communication channel. In oneembodiment, the communication channel comprises a suitable broad-bandcommunication channel. Computers 902 and 904 are generally adapted toutilize program storage devices embodying machine-readable programsource code, which is adapted to cause the computers 902 and 904 toperform the method steps and processes disclosed herein. The programstorage devices incorporating aspects of the disclosed embodiments maybe devised, made and used as a component of a machine utilizing optics,magnetic properties and/or electronics to perform the procedures andmethods disclosed herein. In alternate embodiments, the program storagedevices may include magnetic media, such as a diskette, disk, memorystick or computer hard drive, which is readable and executable by acomputer. In other alternate embodiments, the program storage devicescould include optical disks, read-only-memory (“ROM”) floppy disks,memory sticks, flash memory devices and other semiconductor devices,materials and chips.

Computer systems 902 and 904 may also include one or moremicroprocessors for executing stored programs. Computer 902 may includea data storage device 908 on its program storage device for the storageof information and data. The computer program or software incorporatingthe processes and method steps incorporating aspects of the disclosedembodiments may be stored in one or more computers 902 and 904 on anotherwise conventional program storage device. In one embodiment,computers 902 and 904 may include a user interface 910, and/or a displayinterface 912 from which aspects of the disclosed embodiments can beaccessed. The user interface 910 and the display interface 912, which inone embodiment can comprise a single interface, can be adapted to allowthe input of queries and commands to the system, as well as present theresults of the commands and queries, as described with reference toFIGS. 2A through 6I for example.

The aspects of the disclosed embodiments are directed to improving howexcerpts are made to content displayed in a device. Excerpted content isselected through speech recognition for excerption. The excerptedcontent is transferred to a predetermined location or application whileproviding a link back to the source of the excerpted content. A user ofa mobile device can easily create and organize excerpted content, aswell as view the source of that content.

It is noted that the embodiments described herein can be usedindividually or in any combination thereof. It should be understood thatthe foregoing description is only illustrative of the embodiments.Various alternatives and modifications can be devised by those skilledin the art without departing from the embodiments. Accordingly, thepresent embodiments are intended to embrace all such alternatives,modifications and variances that fall within the scope of the appendedclaims.

The invention claimed is:
 1. A mobile device comprising: a display; atangible non-transitory computer readable medium comprising computerreadable program code configured to: collect a speech recognitionvocabulary set that corresponds to content visible on the display suchthat at least one vocabulary word in the speech recognition vocabularyset is the same as a word presented on the display; receive a speechinput designating a segment of the content to be excerpted; and create alink to a source of the excerpted content and display the link with theexcerpted content.
 2. The mobile device of claim 1, where the speechinput comprises at least a first word in the segment to be excerpted andat least a last word in the segment to be excerpted.
 3. The mobiledevice of claim 1, wherein the computer readable program code isconfigured to update the speech recognition vocabulary set as a contentof the display changes.
 4. The mobile device of claim 1, wherein thecomputer readable program code is configured to optically recognizecharacters presented on the display for enabling designation of one ormore recognized characters through speech recognition.
 5. The mobiledevice of claim 1, wherein the speech input corresponds to predeterminedcommands for designating the content to be excerpted.
 6. The mobiledevice of claim 5, wherein the predetermined commands include “firstline”, “first paragraph”, “whole screen”, “next page”, “current page”,“last line”, “reset the beginning word,” “reset the ending word,” orsome combination thereof.
 7. The mobile device of claim 1, wherein thecomputer readable program code is configured to extract speechrecognition grammar rules or statistical models from the content visibleon the display.
 8. The mobile device of claim 7, wherein extracting thespeech recognition grammar rules or statistical models occurs within thedevice or external to the device.
 9. The mobile device of claim 7,wherein the computer readable program code is configured to recognizethe speech input according to the speech recognition grammar rules orstatistical models.
 10. The mobile device of claim 1, wherein thecomputer readable program code is configured to transfer the excerptedcontent to a predetermined location for storage, retrieval, or somecombination thereof.
 11. A tangible non-transitory computer readablemedium comprising computer readable program code configured to: collecta speech recognition vocabulary set that corresponds to content visibleon a display of a device such that at least one vocabulary word in thespeech recognition vocabulary set is the same as a word presented on thedisplay; receive a speech input designating a segment of the content tobe excerpted; and create a link to a source of the excerpted content anddisplay the link with the excerpted content.
 12. The computer readablemedium of claim 11, wherein the device is a mobile device comprising thecomputer readable medium.
 13. The computer readable medium of claim 11,wherein the computer readable program code is configured to extractspeech recognition grammar rules or statistical models from the contentvisible on the display.
 14. The computer readable medium of claim 11,wherein the computer readable program code is configured to transfer theexcerpted content to a predetermined location for storage, retrieval, orsome combination thereof.
 15. An apparatus comprising: at least oneinput device configured to receive a speech input; a display configuredto present predetermined content acquired by the apparatus from whichexcerpts may be extracted; and a processor configured to executecomputer readable program code, wherein the computer readable programcode is configured to: collect a speech recognition vocabulary set thatcorresponds to content visible on the display such that at least onevocabulary word in the speech recognition vocabulary set is the same asa word presented on the display; designate a segment of the content tobe excerpted based on the speech input; and create a link to a source ofthe excerpted content and display the link with the excerpted content.16. The apparatus of claim 15, where the speech input comprises at leasta first word in the segment to be excerpted and at least a last word inthe segment to be excerpted.
 17. The apparatus of claim 15, wherein thecomputer readable program code is configured to present on the displayan excerpt organizer, the excerpt organizer including at least oneexcerpt content and at least a source of the excerpt content.
 18. Theapparatus of claim 15, wherein the at least one input device comprisesan imaging device configured to optically recognize characters forenabling the designation of excerpt content through speech recognition.19. The apparatus of claim 15, wherein the computer readable programcode is configured to direct a presentation of excerpt selections on thedisplay, the excerpt selections being configured to enable designationof at least a portion of the content to be excerpted through speechrecognition.
 20. The apparatus of claim 15, wherein the apparatus is amobile communication device.